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Abstract The goal of this paper is to solve a class of high-order polynomial 
benchmark optimization problems, including the Goldstein-Price problem and 
the Three Hump Camel Back problem. By using a generalized canonical dual- 
ity theory, we are able to transform the nonconvex primal problems to concave 
dual problems over convex domain(without duality gap), which can be solved 
easily to obtain global solutions. 
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1 Introduction 

Polynomial optimization problems have been widely studied in various fields 
such as nonlinear algebra, semidefinite programming, and operations research, 
with extensive applications in production planning, location and distribution, 
engineering design, risk management, water treatment and distribution, chem- 
ical process design, pooling and blending, structural design, signal processing, 
robust stability analysis, design of chips, and much more (see [203 )• 
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Due to the nonconvexity, traditional direct methods for solving polynomial 
optimization problems are usually very difficult, or even impossible. For ex- 
ample, the algebraic method for the task is to find all of the critical points 
firstly and then to identify the global minimizer(s) among all these critical 
points. This approach becomes inefficient when there exist numerous local 
minima. Also, linearization and relaxation techniques were used to compute 
an approximate optimal solution of the primal problem. However, the approxi- 
mate optimal solution was not guaranteed to be the actual global optimum [3 , 
3]. In [5], the so-called Z-eigenvalue methods were proposed to solve the best 
rank-one approximation problem, but they can be applied only for third-order 
polynomials. Besides these deterministic methods, stochastic techniques have 
also made significant contributions to the optimization applications of this 
kind 6,7 . For example, the evolutionary computation method, could solve 
general problems in low dimension, but it failed to do well for large scale ones 
[81IWTU] . Generally speaking, due to the lack of a theory for identify the global 
minimizer(s), many polynomial optimization problems are considered to be 



The canonical duality theory was originated in the late 1980s by Gao and 
Strang, and has developed significantly in recent years, both theoretically and 
practically [TT1IT!?] . Actually, the canonical duality theory has been success- 
fully applied to solve some special polynomial optimization problems. In [13] . 
a special polynomial minimization problem called canonical polynomial was 
completely solved by the canonical duality theory. In [14] , the theory was used 
to solve a special 8th order polynomial minimization problem. Recently, canon- 
ical dual solutions to sum of fourth-order polynomials minimization problems 
have also achieved [15] . This paper aims to solve some general polynomial 
benchmark problems by using a generalized canonical duality theory. Experi- 
mental results show that these polynomial benchmark problems can be solved 
completely by the canonical duality theory. 

2 A brief review of the canonical duality theory 

Let's consider the following general polynomial optimization problem (primal 
problem) 



where, A € IR™ xn is a given symmetrical indefinite matrix, f € M. n is a given 
vector, W(x) : 1™ — ► K is a general nonconvex C 2 function. 

The main procedures of general methodology of the canonical duality the- 
ory can be summarized as the following three steps: 

Step 1: Canonical dual transformation 

Introducing a nonlinear operator (a Gateaux differentiable geometrical 
measure) 



iVP-hard. 




(1) 



£ = A(x) :R"44cl' 



m 



(2) 
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and a convex function V : £ a — > K such that W(x) can be recast by W(x) = 
V(A(x)). Then the primal problem can be rewritten as the canonical form: 

mm |p(x) = V(A(x)) - U(x)}, (3) 

where t/(x) = — ^x T j4x + x T f. 

Step 2: Generalized complementary function 

The dual variable ? to £ is defined by the duality mapping 

? = W(0:£a->£:cR m , (4) 

which should be invertible, due to the convexity of V(£). Then the Legendre 
conjugate V*(s) of V^(£) can be uniquely defined by the Legendre transforma- 
tion 

F*(<0=sta{£ T <r-T/(£)|£e£ a } (5) 

and the following canonical duality relations hold on £ a x £* : 

« = £ = VV* (?) ^ V (|) + V* (?) = £ T ?. (6) 

Replacing W(x) = V(A(x)) by A(x) T ? — V*(s), we obtain the following 
generalized complementary function: 

3 (x, ?) = A(x) T ? - V* (?) - U(x) : R n x -> K. (7) 

Step 3: Canonical dual function 

By using the generalized complementary function, the canonical dual func- 
tion P d (?) can be formulated as 

P d (?) = sta{~(x,?)|x g R n } = P A (?) - (8) 

where U A (<;) is defined by 

C/ A (^) = sta{A(x) T <; - f/(x)|x G K"}. (9) 

Let <S a C be a dual feasible space such that U (?) is well-defined, and 
the canonical dual problem can be obtained as 

(P d ) : sta{P d (?)|? G So}. (10) 

Theorem 1 (Complementary-Dual Principle) [T^]- The problem {V d ) 
is canonically dual to the primal problem (P) in the sense that if (x, ?) is a 
critical point of 3(x, ?), then x is a feasible solution of (P), ? is a feasible 
solution of (P d ), and 

P(x)= »(x,?-) = P d (?-). (11) 
In many applications, the geometrical operator A(x) is usually quadratic 

A(x) = {^x T C fe x + x T b fe } : R n -> £ a C M m , (12) 



1 



Xiaojun Zhou ct al. 



where Ck € M™ x " and € M. n are given. In this case, the canonical dual 
function can be formulated in the form of 

P d (<;) = - V^G-^FCO - V*(s), (13) 

which is well defined on 

S a = {<;E R m |F«) e C oi (G(^))}, (14) 

where G(<j) = A + J^l-Li ftAri F M = f Efcli <^ b fc> and C o/(G(<r)) denotes 
the column space of G(<j). 
Let the positive domain 

5 a + = {<; e 5„|G(s) h 0} (15) 

where G(s) h indicates that G(<?) is a positive semi-definite matrix. 

Theorem 2 (Global Optimality condition) [12]. Suppose ? is a critical 
point of P d and x = G _1 (s)P(s)- If ^ G S+, then <f is a global maximizer of 
(V ) on S+ if and only if x is a global minimizer of (V) on W 1 , i.e., 

P(x) = min P(x) 4^ max P d (<;) = P d (C). (16) 

Some polynomial problems have already been given to testify the effective- 
ness of canonical duality theory, but most of them are no more than fourth 
degree (see |15jV Although some larger degree polynomial problems are com- 
pletely solved by the same theory, they belong to a special case (see [T3"Ill4| b 
In the next two sections, we are to solve some general polynomial benchmark 
optimization problems (they are also not obvious to find the global optimum 
by observation), aiming to expand the use of canonical duality methodology. 



3 Application for Goldstein-Price problem 

The Goldstein-Price problem is given in the form of |16j : 

mmfx(x,y) = [1 + (x + y + 1) 2 (19 - 14a; + 3x 2 - 14y + 6xy + 3y 2 )]x 
[30 + (2x - 3y) 2 (18 - 32.x + 12.x 2 + 48y - 36xy + 27y 2 )}. 

The landscape and contour of Goldstein-Price function are given in FigjT] 
and we can find that there exist a few extrema. Due to the nonconvexity of 
the problem, it is not easy to find the global minimum. 

By using the following linear transformation 

-(*-*) (i7) 

the Goldstein-Price function can be rewritten to 

h(x,y) = h(s)g{t) (18) 
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Fig. 1 Graph and contour of Goldstein-Price function 



where 

h(s) = 1 + (s+ 1) 2 (19- 14s + 3s 2 ) (19) 

and 

g(t) = 30 + t 2 (18- I6t + M 2 ) (20) 

Proposition 1 Under the linear transformation T(x,y), the Goldstein- 
Price problem is equivalent to the decoupled problems as follows 

min/ifir, y) = mmh(s)mhig(t) (21) 

x,y s t 

Proof. Since the linear transformation in (11) is independent, and h(s),g(t) 
are bounded below, it is easy to see the proposition follows. □ 
Next, we will solve min/ifs) and mhig(t) separately. 

s t 

For h(s), we can find that Vs, h(s) = (1 + (s + l) 2 ((V3s - ^) 2 + §)) > 0, 
and there is only one critical point s = — 1 for h(s), that is to say, s* = —1 is 
the global minimum of h(s). 

For g(t), we rewrite it to the following canonical form 

git) = V(A(t)) - U(t) (22) 

where, V(A(i)) = 3(i 2 - ft - 2) 2 - 9(i 2 - ft - 2), and U(t) = -ft 2 + 56t. 
Introducing a nonlinear operator 

e = A(t)=^-|t-2 = (,-|) 2 -| l >-£ (23) 



then 

V(0 = 3£ 2 - 9£, <;= 6£ - 9 > -y, V*( S ) = (24) 
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therefore, we get the generalized complementary function 



g(s,t) = A(t)<;-V*(s)-U(t) 

? + 18<r + 81 53 
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^-t 2 - 56t 

- > 



53, 2 ,8 „. c 2 + 18c + 81 „ 
= (? + T )* 2 - (3? + 56)t - 2 ? , (25) 

For a given the criticality condition g t (s,t) — leads to the canonical 
equilibrium equation 



2( C +f)t=! ? + 56. 



(26) 



Substituting t = (§? + 56)/(2(? + f )) into ff(c,t), we obtain the dual 



function 



1 ^8£j.Kfir 



(27) 



which is concave in the positive domain 



^3 

5+={?k + y>0}. 



The plots of g(t) and P d (?) are illustrated in Figj^j 



(28) 
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Fig. 2 
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The primal and dual of g(t) 
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Using the sequential quadratic programming method from the Optimiza- 
tion Toolbox within the MATLAB environment for P d (<;) over S+, we can get 
T = — 15. Then we get the corresponding t* = (|<^ + 56)/2(<j + ^) = 3 by using 



the canonical equilibrium equation ( 26 ) 
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By the inverse linear transformation of (17), we can obtain the global min- 
imum to fi(x. y) 



which is indeed the global minimum with the result given in [16] . 



4 Application for Three Hump Camel Back problem 

The Three Hump Camel Back problem is given in the form of |17j : 

Jo 



mm /bOs, y) = 2a; —1.05a; + — 

x,y 6 



xy + y 



The landscape and contour of Three hump camel back function are given 
m Figj3j and we can find that there also exist a few extrema. The nonconvexity 
also makes it difficult to find the global minimum. 





Fig. 3 Graph and contour of Three Hump Camel Back function 



Firstly, we rewrite f2(x,y) to the following canonical form 



f 2 (x,y) = -(V 1 (A 1 (x,y))-Ui(x,y)), 
6 



(29) 



where, Vi(Ai(x,y)) = (x 3 - 3.2a;) 2 , Ui(x,y) = -O.lx 4 - 1.76a; 2 - 6xy - 6y 2 . 
Introducing a nonlinear operator 



£i = Ai(a:) = x 3 - 3.2a;, 



(30) 



then 



(31) 



s 
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thus, we can get the first generalized complementary function 
h^i,x,y) = l - ( Ax (a;) a _ v?( ft )_ U x {x,y)) 



i ((a; 3 - 3.2x)^i - iq 2 + 0.1a; 4 + 1.76a; 2 + 6a;y + 6y 2 ) . (32) 



6 

Again, the / 2 (ft,:c,2/) can be rewritten to 

h{si,z,V) = gQ(V2(A 2 (a;,y,ti)) - J7 2 (a;,y,ci)), 



(33) 



where, y 2 (A 2 (x, y, = {x 2 + 5<; 1 x) 2 , U 2 {x 1 y,q 1 ) = (25q 2 - 17.6)a; 2 + 32 ?1 a; 
60a;?/-60y 2 + 2.5<T 2 . 

Then, we introduce another nonlinear operator 

£ 2 = A 2 (a;,<ri) = a; 2 + 5ftx, 



thus 



(34) 
(35) 



consequently, we obtain the final generalized complementary function 



/2(ft,S2,a,y) = ^r(A 2 (a;,ft)ft - V 2 *(? 2 ) - U 2 (x,y,^i)) 
60 

(^ - -xft 2 + ^7:)a; 2 + V 2 +xy + (-^rftft - 7~ft)£ - 



; l-i¥ 2 + S )x2+y2+xy+( ii- 15 

For given and 52, the criticality condition VS'i(ci,C 2) ^ ) J/) = leads to 
the following canonical equilibrium equations 

„/22 5 , cr 2 N , 1 8 , „ 

2( 75-T2^ + 60 )x + y+( 12^ 2 -T5 ft) = ° 
2y + a; = 

and finally we obtain the canonical dual function 

-1250<r 4 - 50q 2 (3U 2 - 105) + <;f(5<r 2 + 13) 



(37) 



P d (s) - 

y ' 240(125cr 2 - 5^ 2 - 13) 

which is concave in the positive domain 



St 



5_r z -4- 52. n ^ 

75 12^1 + 60 U -° 

0.5 1 



^0 



(38) 



(39) 



Using the sequential quadratic programming method from the Optimiza- 
tion Toolbox within the MATLAB environment for P d (<;) over £+, we can get 
<Ti = 0,<r 2 = 0. According to the canonical equilibrium equations (37), we can 
obtain the corresponding 



Z V 7 5 12^1 + W> 1 

1 2 



15 



ft 



Jftft 







which is indeed the global minimum with the result given in |17) 
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5 Conclusion 

When the canonical duality methodology is applied to a special class of poly- 
nomial optimization problem, it has the ability to solve the class of problem 
completely. On the other hand, for a general polynomial problem, we can also 
design appropriate canonical dual transformation to achieve the goal. As for 
Goldstein-Price problem, we transform it to decoupled minimization problems, 
and then solve them separately While for Three hump camel back problem, we 
can utilize two-level canonical dual transformations. The completely solutions 
of the general polynomial benchmark functions have witnessed the powerful- 
ness of the canonical duality methodology again. 

References 

1. Mevissen, M.: Introduction to concepts and advances in polynomial optimization. Tuto- 
rial at the ETH Zurich summer school New Algorithm Paradims in Optimization (2008) 

2. Tuy, H.: Polynomial optimization: a robust approach. Pacific Journal of Optimization. 
1, 357-374 (2005) 

3. Parrilo, P.A. and Sturmfels, B.: Minimizing polynomial functions, In Algorithmic and 
Quantitative Real Algebraic geometry. DIMACS Series in Discrete Mathematics and The- 
oretical Computer Science. 60, 83-99 (2003) 

4. Kojima, M., Kim, S.Y. and Waki, H.: A general framework for convex relaxation of 
polynomial optimization problems over cones. Journal of the Operations Research. 46(2), 
125-144 (2003) 

5. Qi, L.Q., Wang, F. and Wang, Y.J.: Z-eigenvaluc methods for a global polynomial opti- 
mization problem. Math. Program., Ser. A. 118, 301-316 (2009) 

6. Fleming, P.J., Purshouse, R.C.: Evolutionary algorithms in control systems engineering: 
a survey. Control Engineering Practice. 10, 1223-1241 (2002) 

7. Ashlock, D.: Evolutionary computation for modeling and optimization. Springer- Verlag, 
New York (2006) 

8. Kelly, C.T.: Iterative methods for optimization. SIAM publications, Philadelphia (1999) 

9. Hendrix, E.M.T., Toth, B.C.: Introduction to Nonlinear and Global Optimization. 
Springer- Verlag, New York, NY USA (2010) 

10. Ho, S.H., Shu, L.S. and Chen, J.H.: Intelligent evolutionary algorithms for large parame- 
ter optimization problems. IEEE Transaction on evolutionary computation. 8(6), 522-541 
(2004) 

11. Gao, D.Y. and Strang G.: Geometric nonlinearity: potential energy, complementary 
energy, and the gap function. Quarterly journal of applied mathematics. XLVII(3), 487- 
504 (1989) 

12. Gao, D.Y.: Caonical duality theory: Unified understanding and generalized solution 
for global optimization problems. Computers and Chemical Engineering. 33, 1964-1972 
(2009) 

13. Gao, D.Y.: Complete solutions and extremality criteria to polynomial optimization prob- 
lems. Journal of Global Optimization. 35, 131-143 (2006) 

14. Gao, K.T.: Solutions to 8th order polynomial minimization problem. The Electronic 
Journal of Mathematics and Technology. 1(3), 271-276 (2007) 

15. Gao, D.Y., Ruan, N. and Pardalos, P.M.: Canonical dual solutions to sum of fourth- 
order polynomials minimization problems with applications to sensor network localization, 
in Sensors: Theory, Algorithms and Applications. 61(1), 37-54 (2012) 

16. Molga, M., and Smutnicki, C: Test functions for optimization needs. 
http://www.zsd.ict.pwr.wroc.pl/filcs/docs/functions.pdf (2005) 

17. Mishra, S.K.: Some new test functions for global optimization and performance of re- 
pulsive particle swarm method. Social Science Research Network (SSRN) Working Papers 
Series, |http://ssrn.com/abstract=927134| (2006) 



